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Program description The Accelerated Reader/Reading Renaissance program (now 

called Accelerated Reader Best Classroom Practices) is a guided 
reading intervention In which teachers direct student reading 
of text. It involves two components. Reading Renaissance, the 
first component, is a set of recommended principles on guided 
reading (or teachers’ direction of students’ interactions with text). 



Accelerated Reader (AR), the second component, is a computer 
program that facilitates reading practice by providing students and 
teachers feedback from quizzes based on the books the students 
read. The program gives students opportunity to practice reading 
books at their level, provides feedback on student comprehension 
of books, and helps students establish goals for their reading. 



Research One study of Accelerated Reader/Reading Renaissance met The WWC considers the extent of evidence for Accelerated 

the What Works Clearinghouse (WWC) evidence standards. The Reader/ Reading Renaissance to be small for comprehension 

study included 910 students from grades K to 3 attending 11 and for general reading achievement. No studies that met WWC 

schools In a southern school district in the United States.^ standards with or without reservations addressed alphabetics or 

fluency. 

Effectiveness Accelerated Reader/Reading Renaissance was found to have potentially positive effects on comprehension and general reading 
achievement. 





Alphabetics 


Fluency 


Comprehension 


General reading achievement 


Rating of effectiveness 


na 


na 


Potentially positive effects 


Potentially positive effects 


Improvement index^ 


na 


na 


+12 percentile points 


Average: +17 percentile points 
Range: +10 to +25 percentile points 
na = not applicable 



1. The evidence presented in this report is based on available research. Findings and conclusions may change as new research becomes available. 

2. These numbers show the average and range of improvement indices for all findings across the study. 
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Developer and contact 

Developed by Judi and Terry Paul, Accelerated Reader/Read- 
ing Renaissance is distributed by Renaissance Learning, Inc. 
Address: PO Box 8036, Wisconsin Rapids, Wisconsin 54495- 
8036, USA. Email: answers@renlearn.com. Web: www.renlearn. 
com/reading. htm. Telephone: (800) 656-6740. 

Scope of use 

The Accelerated Reader software prototype was created in 
1984. In 1992, research began to focus on best practices related 
to Accelerated Reader. These efforts led to the development 
of Reading Renaissance, first introduced to educators in 1996 
through professional development seminars. According to the 
developers, more than 65,000 schools nationwide are using 
Reading Renaissance components in a wide variety of academic 
settings. 

Teaching 

A primary component of Reading Renaissance is a dedicated 
30-60 minute block of time for reading practice. Depending on 
the age and skill levels of the students, three activities might 
occur during the reading block: reading texts to a child, reading 
texts to a child using a paired-reading technique, or independent 
reading by the child. In pre-K through third grade, reading 
practice is heavily weighted toward the first two segments. As 



children develop decoding skills, they transition increasingly 
to independent reading. Initially, students take an Acceler- 
ated Reader test to determine their independent reading level 
and select books marked at this level. After completing each 
subsequent book, students take a comprehension quiz and 
earn points based on the number of correct responses and the 
reading level of the book. Teachers use the quizzes to identify 
appropriate reading texts for each student, monitor student 
progress, and identify students who may need remediation. 

Schools or classrooms use points to set individual student 
goals for the quantity and quality of student reading and to 
monitor the student’s progress. Accumulating of points is 
intended to be motivational; teachers also may choose to imple- 
ment a system of rewards. 

Cost 

The school version of Accelerated Reader software can be 
ordered for $4 a student a year with a one-time school fee of 
$1,499. Professional development for using Accelerated Reader/ 
Reading Renaissance is available at additional cost and can 
be customized in terms of length and mode of delivery (onsite, 
telephone/online, regional seminars). The annual cost of full 
implementation, which may vary depending on the school size 
and components implemented, ranges from $3,000 to $10,000 a 
school year. 



Thirty-five studies reviewed by the WWC investigated the effects 
ot Accelerated Reader/Reading Renaissance or some subset 
of its components. One study (Ross, Nunnery, & Goldfeder, 
2004) was a randomized controlled trial that met WWC evidence 
standards. The remaining studies did not meet WWC evidence 
standards. 



Met evidence standards 

Ross, Nunnery, & Goldfeder (2004) was a randomized controlled 
trial that included 45 teachers and 910 students in grades K- 3 
in 11 schools in a southern school district of the United States.® 
Within each school, a minimum of two teachers within one grade 
volunteered to be randomly assigned to implement either the 
intervention. Accelerated Reader/Reading Renaissance, or the 
comparison, a commercially available basal reading program 
used across all schools. 



3. The full study Includes 77 teachers In grades K-6, but since the focus of this topic review Is on outcomes of students In grades K-3, this Intervention 
report focuses on results for the sub-sample of 45 teachers and 910 students In grades K-3. 
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Rssearch (continued) Extent of evidence 

The WWC categorizes the extent of evidence in each domain as 
small or moderate to large (see the What Works Clearinghouse 
Extent of Evidence Categorization Schemed The extent of 
evidence takes into account the number of studies and the 
total sample size across the studies that met WWC evidence 
standards with or without reservations."^ 



The WWC considers the extent of evidence tor Accelerated 
Reader/Reading Renaissance to be small for comprehension 
and for general reading achievement. No studies that met WWC 
standards with or without reservations addressed alphabetics or 
fluency. 



Effectiveness Findings 

The WWC review of beginning reading addresses student 
outcomes in four domains: alphabetics, reading fluency, com- 
prehension, and general reading achievement.® The /tcce/erafed 
Reader/Reading Renaissance study addressed outcomes in 
comprehension and general reading achievement. The findings 
below Include both the authors’ estimates and WWC-calculated 
estimates of the size and statistical significance of the effects of 
Accelerated Reader/Reading Renaissance on students. 

The STAR Early Literacy test and STAR reading test are 
the only outcomes reported In the study. The STAR tests are 
developed and distributed by Renaissance Learning, which also 
distributes Accelerated Reader/Reading Renaissance.^ 

Comprehension. Ross, Nunnery, & Goldfeder (2004) 
reported a positive and statistically significant effect of 
Accelerated Reader/Reading Renaissance on third grade 
student performance on the reading comprehension measure 
(Star Reading test). In WWC computations, this positive effect 
was not statistically significant, but considered substantively 



important according to WWC criteria (an effect size greater 
than 0.25). 

General reading achievement. Ross, Nunnery, & Goldfeder 
(2004) showed that Accelerated Reader/Reading Renaissance had 
positive and statistically significant effects on the general reading 
measure (Star Early Literacy test) for kindergarten, first, and second 
grade students. According to WWC analysis, the average effect 
size across grade levels was statistically significant. 

Rating of effectiveness 

The WWC rates the effects of an intervention in a given outcome 
domain as: positive, potentially positive, mixed, no discernible 
effects, potentially negative, or negative. The rating of effective- 
ness takes into account four factors: the quality of the research 
design, the statistical significance of the findings,^ the size of 
the difference between participants In the intervention and the 
comparison conditions, and the consistency in findings across 
studies (see the WWC intervention Rating Scheme) . 



4. The Extent of Evidence categorization was developed to tell readers how much evidence was used to determine the intervention rating, focusing on the 
number and size of studies. Additional factors associated with a related concept, external validity, such as students’ demographics and the types of 
settings in which studies took place, are not taken into account for the categorization. 

5. For definitions of the domains, see the Beginning Reading Protocol . 

6. According to Renaissance Reading research, STAR and STAR Early Literacy tests are correlated to other standardized reading tests (see Appendix A2.1 
and A2.2). 

7. The level of statistical significance was reported by the study authors or, where necessary, calculated by the WWC to correct for clustering within 
classrooms or schools and for multiple comparisons. For an explanation, see the WWC Tutorial on Mismatch . See Technical Details of WWC-Con- 
ducted Computations for the formulas the WWC used to calculate the statistical significance of the findings. In the case ot Accelerated Reader/Reading 
Renaissance, a correction for clustering was needed and the statistical significance of the authors’ findings and WWC findings differ. 
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The WWC found 
Accelerated Reader/ 
Reading Renaissance 
to have potentially 
positive effects for 
comprehension and general 
reading achievement 



Improvement index 

The WWC computes an improvement index for each individual 
finding. In addition, within each outcome domain, the WWC 
computes an average improvement index for each study and an 
average improvement index across studies (see Technicai Details 
of WWC-Conducted Computations) . The improvement index rep- 
resents the difference between the percentiie rank of the average 
student in the intervention condition versus the percentiie rank 
of the average student in the comparison condition. Unlike the 
rating of effectiveness, the improvement index is based entireiy 
on the size of the effect, regardiess of the statisticai significance 
of the effect, the study design, or the analyses. The improvement 
index can take on vaiues between -50 and +50, with positive 
numbers denoting resuits favorabie to the intervention group. 



The improvement index for comprehension for third grade 
students is +12 percentile points. The average improvement 
index for general reading achievement is +17 percentiie points 
with a range of +10 to +25 percentiie points across kindergarten, 
first, and second grade students. 

Summary 

The WWC reviewed 35 studies on Accelerated Reader/Reading 
Renaissance or some of its components. One of these studies 
met WWC evidence standards; the remaining studies did not 
meet WWC evidence screens. Based on this study, the WWC 
found potentiaiiy positive effects in the comprehension and gen- 
eral reading achievement domains. The evidence presented in 
this report is limited and may change as new research emerges. 
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Appendix A1 


Study characteristics: Ross, Nunnery, & Goidfeder, 2004 (randomized controiied triai) 


Characteristic 


Description 


Study citation 


Ross, S.M., Nunnery, J., & Goidfeder, E. (2004). A Randomized Experiment on the Effects of Accelerated Reader/Reading Renaissance in an Urban School District: Preliminary 
Evaiuation Report. Memphis, TN: University of Memphis, Center for Research in Educational Policy. 


Participants 


In each of 11 schools, a minimum of two teachers at the same grade level volunteered to be randomly assigned either to implement Accelerated Reader (AR)/Reading Renais- 
sance or to serve as a comparison teacher. Although participants were in grades K-6, only students in grades K-3 are relevant for this review. Eor grades K-2, 32 teachers 
(642 students) were randomly assigned to an intervention or comparison group. The analysis sample of kindergarten to second grade students included 394 students for 
whom pre- and posttest scores were available. There was no attrition of classrooms, but there was considerable student-level attrition in some grades and the authors estab- 
lished equivalence of pretest scores for intervention and comparison students in the post-attrition sample. Eor third grade, 13 teachers (268 students) were randomly assigned 
to an intervention or a comparison group. There was also no attrition of classrooms for the third grade sample, but approximately one-third of the students were missing either 
a pre- or posttest score, and 178 students are included in the analysis. Pretest scores were used as a covariate in outcome analyses. Over 80 percent of the students were 
eligible for free or reduced price lunch and approximately 3 percent were identified as having a learning disability.^ 


Setting 


Students attended 11 schools in Memphis, Tennessee. 


Intervention 


Teachers assigned to the intervention group implemented the Accelerated Reader/Reading Renaissance program (the computer software and the professional development on 
best practices for AR). The authors report that the study occurred over an eight-month period during the 2002-2003 school year. 


Comparison 


The participating district required a 90-minute reading block in the participating grades. All schools in the study used the same commercially available basal reading program. 
Participating schools were implementing sustained silent reading programs to support fluency, comprehension, and vocabulary development. Comparison teachers were told 
that the Accelerated Reader/Reading Renaissance program would be available to them in the following school year. 


Primary outcomes 
and measurement 


The STAR Early Literacy Test was administered to students in kindergarten to second grade in September (pretest) and April (posttest). The STAR Reading Test was adminis- 
tered to third graders at the same time points (see Appendix A2.1-2.2 for more detailed descriptions of outcome measures). 


Teacher training 


The developer of the program, Renaissance Learning, trained teachers assigned to the intervention group to implement Accelerated Reader/Reading Renaissance. In addition, 
at least once a month throughout the year, Renaissance consultants met with teachers in order to provide technical assistance and provide feedback on implementation. 



1. These demographic characteristics pertain to the entire K-6 grade sampie, not oniy to the K-3 sampie of interest for this review. 
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Appendix A2.1 Outcome measures in the comprehension domain 



Outcome measure 


Description 


STAR Reading Test^ 


The test is a computer-adaptive, norm-referenced test that measures student reading comprehension. It is designed for students who have at least a 100-word reading 
vocabulary and can be used with all students in grades 1-12. Students read passages of text and fill in key missing words from a set of options (moditied cloze procedure). 
The assessment is designed tor repeated administration throughout the school year to monitor progress (as cited in Ross, Nunnery, & Goldfeder, 2004). 



1. This test was developed by Renaissance Learning, the developer of Accelerated Reader/Reading Renaissance. According to Renaissance Reading research, STAR reading scale scores are 
correlated to other standardized reading tests (such as, depending on the grade and time point, .67 to .85 for California Achievement Test; .62 to .89 for the Gates McGinitie Test; and .71 for the 
Degrees of Reading Power test). See Nebelsick-Gullett, L. Review of STAR Reading®, version 2.2. In B. S. Plake, J. C. Impara, & R. A. Spies (Eds.), The fifteenth mental measurements yearbook. 
Lincoln, NE: Buros Institute of Mental Measurements. Retrieved March 02, 2007, from Buros Institute of Mental Measurements Web site; http;//www.unl.edu/buros/. 



Appendix A2.2 Outcome measures in the generai reading achievement domain 



Outcome measure 


Description 


STAR Early Literacy Test^ 


The test measures seven major domains: general readiness, grapho-phonemic knowledge, phonemic awareness, phonics, comprehension, structural analysis, and vocabulary. 
It is a computer-adaptive audio test (students wear headphones and the test is read to them). The test can be administered to non-readers and to students who do not have a 
high enough reading vocabulary (100 words) to take the STAR Reading Test on their own. The assessment is designed for repeated administration throughout the school year 
to monitor progress (as cited in Ross, Nunnery, & Goldfeder, 2004). 



1. This test was developed by Renaissance Learning, the developer of Accelerated Reader/Reading Renaissance. According to research conducted by Renaissance Learning, STAR Early Literacy 
Test is correlated to other standardized reading tests (average correlations range from .57 to .64 between STAR Early Literacy and Brigance K & 1 Screen for Kindergarten and First Grade, DIAL, 
Iowa Test of Basic Skills, and Stanford Achievement Test). See Graham, T. (2003). Review of STAR Literacy®. In B. S. Plake, J. C. Impara, & R. A. Spies (Eds.), The fifteenth mental measurements 
yearbook. Lincoln, NE: Buros Institute of Mental Measurements. Retrieved March 02, 2007, from Buros Institute of Mental Measurements Web site: http://www.unl.edu/buros/. 
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Appendix A3.1 



Summary of study findings inciuded in the rating for the comprehension domain^ 









Authors’ findings from the study^ 














Mean outcome 
(standard deviation^) 




WWC calculations 




Outcome measure 


Study 

sample 


Sample size 
(teachers/ 
students) 


AR/RR Comparison 

group group 


Mean difference'* 
{AR/RR - 
comparison) 


Statistical 
significance^ 
Effect size® (at a = 0.05) 


Improvement 

index^ 



Ross, Nunnery, & Goldfeder, 2004 (randomized controlled trial)® 








STAR Reading Test Grades 13/178 389.5 336.8 52.70 

(139.6) (198.3) 


0.31 


ns 


+12 


Average® for comprehension (Ross, Nunnery, & Goldfeder, 2004) 


0.31 


ns 


+12 



ns = not statistically significant 

1 . This appendix reports findings considered for the effectiveness rating and the improvement index. 

2. The authors adjusted posttest scores for pretest differences between study groups. 

3. The standard deviation across all students in each group shows how dispersed the participants’ outcomes are: a smaller standard deviation on a given measure would indicate that participants had more similar outcomes. 

4. Positive differences and effecf sizes favor the intervention group; negative differences and effecf sizes favor the comparison group. 

5. For an explanation of fhe effecf size calculafion, see Technical Details of WWC-Conducted Computations . 

6. Statistical significance is the probability that the difference between groups is a result of chance rafher than a real difference between the groups. 

7. The improvement index represents the difference befween the percentile rank of fhe average sfudent in the intervention condition versus the percentile rank of fhe average studenf in fhe comparison condifion. The improvemenf index 
can fake on values befween -50 and +50, wifh posifive numbers denoting results favorable fo the intervention group. 

8. The level of staf istical significance was reported by the study authors or, where necessary, calculated by the WWC to correct for clustering within classrooms or schools and for multiple comparisons. For an explanation about the 
clustering correction, see the WWC Tutorial on Mismatch . See Technical Details of WWC-Con ducted C omputations for the formulas the WWC used to calculate statistical significance. In the case of Ross, Nunnery, & Goldfeder (2004), a 
correction for clustering was needed, so the significance levels may differ from those reported in the original study. 

9. The WWC-computed average effect sizes are simple averages rounded to two decimal places and the average improvement indices are calculated from the average effect size. In this case, the average is the same as the single out- 
come measure for the single study. 
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Appendix A3.2 Summary of study findings inciuded in the rating for the generai reading achievement domain^ 









Authors’ findings from the study^ 














Mean outcome^ 
(standard deviation’*) 




WWC calculations 




Outcome measure 


Study 

sample 


Sample size 
(teachers/ 
students) 


AR/RR Comparison 

group group 


Mean difference^ 
(AR/RR - 
comparison) 


Statistical 
significance^ 
Effect size® (at a = 0.05) 


Improvement 

index® 



Ross, Nunnery, & Goldfeder, 2004 (randomized controlled trial)^ 



STAR Early Literacy test 


Kindergarten 


7/92 


644.40 

(114.40) 


569.20 

(94.10) 


75.20 


0.69 


ns 


+25 


STAR Early Literacy test 


Grade 1 


9/97 


733.60 

(96.20) 


698.00 

(97.80) 


35.60 


0.36 


ns 


+14 


STAR Early Literacy test 


Grade 2 


16/205 


791.70 

(72.10) 


772.70 

(82.20) 


19.00 


0.25 


ns 


+10 


Average*® for general reading achievement (Ross, Nunnery, & Goldfeder, 2004) 






0.43 


Statistically 


+17 



significant 



ns = not statistically significant 

1 . This appendix reports findings considered for the effectiveness rating and the average improvement indices. 

2. The authors adjusted posttest scores for pretest differences between study groups 

3. Means were adjusted for pretest score and free lunch status differences. 

4. The standard deviation across all students in each group shows how dispersed the participants’ outcomes are: a smaller standard deviation on a given measure would indicate that participants had more similar outcomes. 

5. Positive differences and effect sizes favor the intervention group; negative differences and effect sizes favor the comparison group. 

6. For an explanation of the effect size calculation, see Technical Details of WWC-Conducted Computations . 

7. Statistical significance is the probability that the difference between groups is a result of chance rather than a real difference between the groups. 

8. The improvement index represents the difference between the percentile rank of the average student in the intervention condition versus the percentile rank of the average student in the comparison condition. The improvement index 
can take on values between -50 and +50, with positive numbers denoting results favorable to the intervention group. 

9. The level of statistical significance was reported by the study authors or, where necessary, calculated by the WWC to correct for clustering within classrooms or schools and for multiple comparisons. For an explanation about the 
clustering correction, see the WWC Tutorial on Mismatch . See Technical Details of WWC-Con ducted Co mputations for the formulas the WWC used to calculate statistical significance. In the case of Ross, Nunnery, & Goldfeder (2004), a 
correction for clustering was needed, so the significance levels may differ from those reported in the original study. 

10. The WWC-computed average effect sizes are simple averages rounded to two decimal places. The average improvement indices are calculated from the average effect size. This row provides the study average based on the findings in 
all three grades. 
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Appendix A4.1 Accelerated Reader/Reading Renaissance rating for the comprehension domain 



The WWC rates an intervention’s effects in a given outcome domain as positive, potentially positive, mixed, no discernible effects, potentially negative, or negative.'' 

For the outcome domain of comprehension, the WWC rated Accelerated Reader/Reading Renaissance as having potentially positive effects. It did not meet the 
criteria for having positive effects because there was only one study for this domain. The remaining ratings (mixed effects, no discernable effects, potentially negative 
effects, negative effects) were not considered because Accelerated Reader/Reading Renaissance was assigned a higher applicable rating. 

Rating received 

Potentially positive effects: Evidence of a positive effect with no overriding contrary evidence. 

• Criterion 1: At least one study showing a statistically significant or substantively important positive effect. 

Met. Accelerated Reader/Reading Renaissance had one study showing a substantively important positive effect on the comprehension domain. 

• Criterion 2: No studies showing a statistically significant or substantively important negative effect and fewer or the same number of studies showing indeterminate 
effects than showing statistically significant or substantively important positive effects. 

Met. Accelerated Reader/Reading Renaissance had no studies showing negative or indeterminate effects on the comprehension domain. 

Other ratings considered 

Positive effects: Strong evidence of a positive effect with no overriding contrary evidence. 

• Criterion 1: Two or more studies showing statistically significant positive effects, at least one of which met WWC evidence standards for a strong design. 

Not met. Accelerated Reader/ Reading Renaissance had only one study that met WWC evidence standards. 

• Criterion 2: No studies showing statistically significant or substantively important negative effects. 

Met. No studies showed statistically significant or substantively important negative effects. 

1 . For rating purposes, the WWC considers the statistical significance of individual outcomes and the domain-level effect. The WWC also considers the size of the domain-level effect for ratings of 
potentially positive or potentially negative effects. See the WWC Intervention Rating Scheme for a complete description. 
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Appendix A4.2 Accelerated Reader/Reading Renaissance rating for the generai reading achievement domain 



The WWC rates an intervention’s effects in a given outcome domain as positive, potentially positive, mixed, no discernible effects, potentially negative, or negative.'' 

For the outcome domain of general reading achievement, the WWC rated Accelerated Reader/ Reading Renaissance as having potentially positive effects. It did not 
meet the criteria for having positive effects because there was only one study for this domain. The remaining ratings (mixed effects, no discernable effects, potentially 
negative effects, negative effects) were not considered because Accelerated Reader/Reading Renaissance was assigned a higher applicable rating. 

Rating received 

Potentially positive effects: Evidence of a positive effect with no overriding contrary evidence. 

• Criterion 1: At least one study showing a statistically significant or substantively important positive effect. 

Met. Accelerated Reader/Reading Renaissance had one study showing a statistically significant positive effect on the general reading achievement 
domain. 

• Criterion 2: No studies showing a statistically significant or substantively important negative effect and fewer or the same number of studies showing indeterminate 
effects than showing statistically significant or substantively important positive effects. 

Met. Accelerated Reader/ Reading Renaissance had no studies showing negative or indeterminate effects on the general reading achievement 
domain. 

Other ratings considered 

Positive effects: Strong evidence of a positive effect with no overriding contrary evidence. 

• Criterion 1: Two or more studies showing statistically significant positive effects, at least one of which met WWC evidence standards for a strong design. 

Not met. Accelerated Reader/ Reading Renaissance had only one study that met WWC evidence standards. 

• Criterion 2: No studies showing statistically significant or substantively important negative effects. 

Met. No studies showed statistically significant or substantively important negative effects. 

1 . For rating purposes, the WWC considers the statistical significance of individual outcomes and the domain-level effect. The WWC also considers the size of the domain-level effect for ratings of 
potentially positive or potentially negative effects. See the WWC Intervention Rating Scheme for a complete description. 
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Appendix A5 Extent of evidence by domain 



Outcome domain 


Number of studies 


Schools 


Sample size 

Students 


Extent of evidence^ 


Alphabetics 


0 


0 


0 


na 


Fluency 


0 


0 


0 


na 


Comprehension 


1 


not specified 


178 


Smaii 


General reading achievement 


1 


not specified 


394 


Smaii 



na = not applicable/not studied 

1. A rating of “moderate to iarge” requires at ieast two studies and two schoois across studies in one domain and a totai sampie size across studies of at ieast 350 students or 14 ciassrooms. 
Otherwise, the rating is “smali.” 
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